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(54) Interactive display presentation system 

(57) An interactive presentation control system, 
used with a display computer, a computer-controlled 
image projector, a laser pointer, and a projection 
screen, comprises a digital camera and a control mod- 
ule. The display computer generates electronic images 
which are projected onto the projection screen as pres- 
entation images. During operation, a presenter uses the 
laser pointer to trace out a pre-established gesture spa- 
tial pattern onto the presentation image. The digital 
camera acquires these presentation images from which 
images a processing section in the control module ana- 



lyzes and identifies the gesture spatial pattern. The 
identified gesture spatial pattern is compared to a set of 
pre-established patterns to find a match and to subse- 
quently select a correlated display command. The dis- 
play command, which can be executed within the 
control module or transmitted to the display computer, 
changes the presentation image by an action such as: 
advancing to the next image, highlighting a text seg- 
ment, or zooming in on the image. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001] The present invention is related to presenta- 
tion systems using a display computer, a computer-con- 
trolled image projector, and a projection screen and, 
more particularly, to an interactive display presentation 
system in which control is accomplished by moving a 
laser pointer beam across the projection screen in a 
pre-established spatial pattern. 

Description of the Related Art 

[0002] Charts, text, and various graphical images 
are commonly presented to an audience in meetings 
and in classrooms by optically projecting these images 
onto a projection screen or a wall. An LCD (liquid crystal 
display) projector is commonly used as the image 
source, where the charts, text, and graphical images 
are electronically generated by a display computer, 
such as a personal computer (PC) or a laptop computer, 
which typically execute presentation -gene rating soft- 
ware, such as Microsoft PowerPoint®. In such display 
systems, the PC provides video outputs such as stand- 
ard VGA, Super VGA, or XGA. These LCD/PC projec- 
tion display systems are becoming more popular than 
the traditional overhead projector and transparencies 
which they replace. 

[0003] Whether the operator is standing at a lec- 
tern, or is moving about before the audience, he has lit- 
tle direct control over the image being displayed upon 
the projection screen when using a conventional 
LCD/PC projection display system. A conventional sys- 
tem requires the operator to return to the display com- 
puter, or to have an assistant seated at the computer, so 
as to provide control for the presentation. At the display 
computer, either the presenter or the assistant controls 
the displayed image by means of keystrokes or by 
"mouse commands" with a cursor in the appropriate 
area of the computer monitor display screen. The 
actions of the operator moving to the display computer, 
or communicating with the assistant, detracts from a 
natural progression and flow of the presentation. It can 
be appreciated that the operator develops a closer rap- 
port with the audience the more he is able to interac- 
tively control the display presentation or to modify the 
image appearing on the projection screen without 
repeatedly redirecting his attention from the screen to 
an assistant or moving to the display computer. 
[0004] For example, with the control system dis- 
closed in U.S. Patent No. 5,782,548, issued to 
Miyashita, the operator uses a remote control device to 
wirelessly transmit control signals to a projector sensor. 
This system requires the operator to turn away from his 
audience and from the projection screen and to direct 



his attention to the projector via the remote control 
device when he wishes to change the presentation 
image on the screen. Moreover, although the operator 
acquires some mobility by means of the remote control 
5 device, the mobility is limited as he must stay in range of 
the projector sensor. 

[0005] It is also known in the art to use a laser 
pointer projecting a laser spot onto to a region of the 
presentation image. Such systems typically require mul- 
w tiple steps or actions to be taken in exercising control 
over the presentation, and this serves to inhibit a natural 
progression and flow of presentation. In way of exam- 
ple, U.S. Patent No. 5,682,181, issued to Nguyen et aL, 
discloses a system in which the operator calls up a 

is drop-down menu before a particular function, such as ^ 
draw mode, page up, etc., can be selected. U.S. Patent 
No. 5,502,459, issued to Marshall et al., discloses a 
method of effecting a mouse double-click in which the 
user must first activate, then deactivate, then activate 

20 again, and again deactivate the laser pointer while 
maintaining the projected laser spot within an imaginary 
rectangular area on the presentation image. Other sys- 
tems require that additional components be used with 
the conventional LCD/PC projection display systems. 

25 U.S. Patent No. 5,504,501, for example, provides 
remote control by means of a laser pointer, but requires 
the use of an optical filter to isolate the laser spot from 
the surrounding presentation image. 
[0006] The prior art does not appear to have pro- 

30 vided an interactive display presentation system in 
which the operator is able to control the presentation, 
such as by providing mouse commands, while retaining 
a high degree of interaction with the audience. It is 
therefore an object of the present invention to provide 

35 such a presentation system which overcomes these 
and other limitations of conventional display presenta- 
tion systems. 

[0007] It is another object of the present invention to 
provide such a system in which mouse commands and 

40 other presentation functions, such as advancing to a 
subsequent image, underlining, zooming in, or high- 
lighting, are executed by simply gesturing with a laser 
pointer. Other objects of the invention will be obvious, in 
part, and, in part, will become apparent when reading 

45 the detailed description to follow. 

Summary of the Invention 

[0008] The present invention provides an interac- 
50 tive presentation control system in which a presenter 
controls the presentation by projecting pre-established 
spatial patterns onto a projection screen by means of a 
laser spot emitted by a laser pointer. The pre-estab- 
lished spatial patterns are acquired and interpreted by 
55 the control system which subsequently issues display 
commands to a projector. During the presentation, a 
display computer generates on its local display a bitmap 
corresponding to the presentation. This bitmap is then 
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transmitted to the LCD projector and the bitmap is then 
projected onto the screen. The display of the presenta- 
tion is controlled by the monitoring of the laser spots 
that are also projected onto the screen. Laser spot con- 
trol is achieved through a control system. The control 5 
system comprises a digital camera which acquires suc- 
cessive images of the laser spot and a control module 
comprising a processing section which analyzes the 
positions of the laser spot across the presentation 
images. r When the processing section matches the sue- 70 
cessive Jaser spot positions with a pre-established spa- 
tial pattern, the corresponding display command is 
issued. The display command may be transmitted to the 
display computer which responds by an action such as 
advancing to the next electronic image, or the display 75 
command may perform a function within the control 
module, such as highlighting text or zooming in on a 
portion of the presentation image. 

Brief Description of the Drawings 20 

[0009] The invention description below refers to the 
accompanying drawings, of which: 

Fig. 1 is a diagrammatical illustration of a first 25 
embodiment of an interactive display presentation 
system comprising a computer-controlled image 
projector, a projection screen, a laser pointer, and a 
control system in accordance with the present 
invention; 30 
Fig. 2 is a diagrammatic plan view of a conventional 
display presentation system showing an operator 
interacting primarily with the display computer while 
an audience follows the presentation images on the 
projection screen; 35 
Fig. 3 is a diagrammatic plan view of the interactive 
display presentation system of Fig. 1 with the pre- 
senter interacting primarily with the audience and 
with the presentation images on the projection 
screen; ao 
Fig. 4 is a diagrammatical illustration of a presenta- 
tion image on the projection screen of the system of 
Fig. 1 showing a laser spot, produced by the laser 
pointer, in the presentation image; 
Fig. 5 illustrates how the positional coordinates of 45 
the laser spot of Fig. 4 are determined; 
Fig. 6 is a diagram of the Freeman chain code con- 
vention used in the present invention to describe 
movement of the laser spot across the presentation 
image of Fig. 4; 50 
Fig. 7 is a diagrammatical representation of a pre- 
established spatial pattern projected onto the pro- 
jection screen by the presenter, the movement of 
the laser spot described by a series of Freeman 
chain codes and identified as a right-hand arrow- 55 
head; and, 

Fig. 8 is a diagrammatical illustration of a second 
embodiment of an interactive display presentation 



system in accordance with the present invention. 
Description of the Preferred Embodiments 

[0010] Fig. 1 shows a first embodiment of an inter- 
active display presentation system 10 comprising a dis- 
play computer 21, a computer-controlled image 
projector 23, a projection screen 12, a laser pointer 1 1 , 
and a presentation control system 30 in accordance 
with the present invention. Image projector 23 typically 
comprises an illumination source 25 and an image 
panel 27 disposed between illumination source 25 and 
projection screen 12. Presentation control system 30 
comprises a digital camera 31, or similar imaging 
device, and a control module 33. During operation of 
presentation system 10, display computer 21 generates 
an initial electronic image 22a from the presentation 
being run by the presentation -gene rating software resi- 
dent in display computer 21. The presentation program 

comprises a set of electronic images 22a, 22b 22k 

intended for projection during the display presentation. 
Initial electronic image 22a is transmitted by display 
computer 21 to control module 33, preferably as a bit- 
map image, for subsequent transmission to image panel 
27 as a projection image 29. Projection image 29 is sub- 
sequently projected onto projection screen 12 as a cor- 
responding initial presentation image 13. 
[001 1 ] A presenter 37 interactively controls presen- 
tation system 10 by using laser pointer 11 to project a 
laser beam 15 impinging on presentation image 13 as a 
laser spot 16. Laser pointer 1 1 is preferably a commer- 
cially-available device capable of emitting both a contin- 
uous and a pulsing radiation beam whose wavelength 
lies between 630 and 670 nm. Presenter 37 moves 
laser spot 16 across projection screen 12 to trace out a 
pre-established gesture spatial pattern and, thus, pro- 
vide control to display presentation system 1 0. The ges- 
ture spatial pattern, which may comprise a horizontal 
underscore, an arrowhead, a box enclosing an image 
portion, or some other pre-assigned geometric shape, 
is subsequently identified by control module 33, which 
then selects a corresponding p re-determined display 
command. The display command may perform a func- 
tion within control module 33, or may be transmitted to 
display computer 21, as explained in greater detail 
below. For example, in one mode of operation, display 
computer 21 receives the display command and 
responds by calling up a subsequent slide 22b for trans- 
mittal to image projector 23 via control module 33. 
[0012] The advantages presented by the inventive 
system can be described with reference to Figs. 2 and 
3. In a conventional presentation, shown in Fig. 2, an 
operator 17 interacts primarily with display computer 21 , 
or with an assistant seated at display computer 21 , to 
control the presentation on projection screen 12, as 
indicated by solid arrow 41 . Operator 17 thus has lim- 
ited interaction with the presentation on screen 12, as 
indicated by dashed arrow 46. In viewing the presenta- 



3 



1 087327 A2_l > 



5 



EP 1 087 327 A2 



6 



tion, the members of an audience 19 direct their atten- 
tion primarily to the presentation, as represented by 
solid arrow 43, and to a lesser degree with operator 17, 
as represented by dashed arrow 45. In comparison, 
with interactive display presentation system 1 0, such as 5 
disclosed herein, a presenter 37 requires little or no 
interaction with, either display computer 21 or with pres- 
entation control system 30, and is thus able to interact 
both with audience 19, as represented by solid arrow 
47, and with the presentation on projection screen 12 w 
via laser pointer 1 1, as represented by solid arrow 48. 
[0013] During operation of presentation control sys- 
tem 30 in Fig. 1, digital camera 31 is directed at projec- 
tion screen 12 so as to continuously sample 
presentation image 13 currently on view, preferably at a 75 
sampling rate of approximately ten frames per second. 
Control module 33 receives these sampled images as a 
corresponding succession of acquired images 63a, 
63b,. ...63n. As can be appreciated by one skilled in the 
relevant art, acquired images 63a, 63b,...,63n are 20 
essentially identical to one another, while presentation 
image 13 remains on projection screen 12, except for 
any changes in the position of laser spot 16 between 
successive acquired images. These successive posi- 
tions of laser spot 1 6 are isolated, retained in a memory 25 
34 and analyzed to identify the gesture spatial pattern 
presenter 37 has projected onto projection screen 12. 
[0014] Control module 33 comprises a processing 
section 35 which detects the presence of laser spot 16 
within successive acquired images 63a, 63b,..., 63n. 30 
Because laser spot 16 comprises image elements hav- 
ing a brightness greater than any image elements com- 
prising presentation image 13, processing section 35 is 
able to locate laser spot 16 by detecting image ele- 
ments having a brightness exceeding a predetermined 35 
threshold, where the threshold is greater than the maxi- 
mum brightness level present in presentation image. 
Processing section 35 analyzes presentation image 13 
for a contiguous aggregate of such bright image ele- 
ments, where the aggregate has a height or a width 40 
approximating the size of laser spot 16. Preferably, 
detection of laser spot 16 is performed first in a lower- 
resolution mode (e.g., where acquired images 63a, 
63b,...,63n are viewed as 80 x 60 pixel images) to find 
the approximate location of laser spot 1 6 within presen- 45 
tation image 13. For example, Fig. 4 shows projection 
screen 12 having laser spot 16 lying within a flow chart 
comprising presentation image 13. When the approxi- 
mate location of laser spot 16 has been determined, 
presentation image 1 3 is analyzed at a higher resolution so 
of 160 x 120 pixels, shown in Fig. 5, and the location of 
laser spot 1 6 is determined to a correspondingly greater 
precision, here at positional coordinates (128, 114). 
[0015] Processing section 35, in Fig. 1, assigns 
successive positional coordinates to the location of 55 
laser spot 16 for each acquired image 63a, 63b,...,63n 
in which laser spot 16 is detected. The series of posi- 
tional coordinates are captured, or stored, in memory 



34 and analyzed for the occurrence of a spatial pattern. 
Control module 33 further comprises a reference sec- 
tion 36 in which are stored a set of pre-established ges- 
ture spatial patterns and a set of pre-assigned display 
commands, each display command assigned, or corre- 
lated, to one of the pre-established gesture spatial pat- 
terns. When a spatial pattern has been identified, 
processing section 35 compares the identified spatial 
pattern with the set of pre-established gesture spatial 
patterns. If a match is found, processing section 35 
selects the display command assigned to the matching 
pre-established gesture spatial pattern and executes 
the selected display command. 

[0016] When transmitted to display computer 21, 
the selected display command is received via an input 
port 65. In a preferred embodiment, input port 65 com- 
prises a serial port, the display command being trans- 
mitted via a serial or a USB cable 39. As can be 
appreciated by one skilled in the relevant art, process- 
ing section 35 may reside in control module 33 as 
shown or, alternatively, may be resident in either digital 
camera 31 or display computer 21 , may be retrieved as 
computer-readable instructions from a storage medium 
67, or may be distributed among any of digital camera 
31, control module 33, and display computer 21. 
[001 7] When a laser spot 1 6 is detected within each 
acquired image 63a, 63b,...,63n, processing section 35 
assigns positional coordinates (e.g., Xj, Vj) to the suc- 
cessive positions of laser spot 16 motion to determine 
whether laser spot 16 is moving, and, if moving, 
whether the movement is random or whether the move- 
ment correlates to one of a number of pre-established 
shapes or patterns. Movement and direction can be 
determined by analyzing the corresponding sequence 
of displacement vectors, />((*m-i — */). 0-7+1 — //)). Pref- 
erably, a spatial pattern recognition tool, known in the 
relevant art as a Freeman chain code, is used to deter- 
mine movement of laser spot 1 6 and detect the forma- 
tion of an arrowhead, a box, or other geometric feature. 
A Freeman chain code assigns a number to the transla- 
tional vector of laser spot 1 6, that is, to a vector describ- 
ing movement from one acquired image 63j to next 
acquired image 63 i+1 . As shown in Fig. 6, a vertical 
movement, represented by a directional vector 71 at | , 
is assigned a "code 1," while a diagonal movement in 
the third quadrant, represented by a directional vector 
73 at ^, is assigned a "code 6," and so on. Processing 
section 35 discriminates between random movement of 
laser spot 16 and an intentional gesture made by pre- 
senter 37 by analyzing the resulting sequence of Free- 
man chain codes. 

[0018] In way of an example, Fig. 7 illustrates how a 
captured gesture spatial pattern is described by a Free- 
man chain code. Control module 33 has captured the 
positional coordinates of laser spot 1 6 in five initial con- 
secutive images in which the motion of laser spot in four 
successive image pairs is described by a series of four 
"code 4s" represented by directional vectors 75a, 75b, 
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75c, and 75d. The motion of laser spot 1 6 in five subse- 
quent images (i.e., acquired images 63f to 63j, not 
shown) is described by a series of five "code 6s M repre- 
sented by directional vectors 77a, 77b, 77c, 77d, and 
77e respectively. 5 
[0019] Processing section 35 compares the cap- 
tured gesture spatial pattern sequence of four consecu- 
tive "code 4" vectors followed by a series of five 
consecutive "code 6" vectors with pre-established ges- 
ture spatial pattern entries provided to processing sec- io 
tion 35 -from reference section 36, which may be a 
randonvaccess memory, firmware, or a look-up table. A 
match determines that the captured gesture comprises 
a right-hand arrow 51. For a captured gesture spatial 
pattern comprising a random series of different Free- is 
man chain codes, processing section 35 would deter- 
mine that random laser spot movement is occurring and 
no display command would be issued. 
[0020] Display presentation system 1 0 can be used 
in a "mouse mode" to project a series of PowerPoint® 20 
slides as presentation images 13. By way of example, if 
presenter 37 traces out a gesture spatial pattern com- 
prising right-hand arrowhead 51 , display computer may 
respond by calling up the next in the series of presenta- 
tion slides for transmittal to image projector 23. That is, 25 
the display command of "Advance to next slide" would 
be correlated, or assigned, to right-hand arrow 51. In 
the same manner, if the gesture spatial pattern com- 
prises a left-hand arrowhead, the previous image may 
be recalled and provided as projection image 29. Alter- 30 
natively,, an arrowhead indicator can be assigned to 
change ithe volume of the audio, or change some other 
slide characteristic of the presentation via a pre-estab- 
lished display command. 

[0021 ] Presenter 37 may also position laser spot 1 6 35 
in a particular region of presentation image 13, such as 
on an icon or over a menu entry. Processing section 35 
interprets this condition as a selection of the surround- 
ing icon or menu entry, equivalent to a first mouse click. 
A second mouse click, subsequent to the action of 40 
selection, is effected by pulsing laser pointer 11 for a 
pre-establisbed time interval, preferably three seconds, 
while laser spot 16 remains in the icon or menu entry. 
Alternatively, positioning laser spot 1 6 in the border of 
. presentation image 13 produces a drop-down menu for 45 
subsequent selection and action. A subsequent single 
pulsing of laser spot 16 on the selected region is subse- 
quently interpreted by processing section 35 as a sec- 
ond mouse click. 

[0022] In this manner, the projection of laser beam so 
15 onto presentation image 13 serves to control the dis- 
play presentation, by opening a new file, cutting, or 
pasting, for example, from essentially any location in the 
presentation room. Thus, laser pointer 1 1 is used with 
presentation control system 30 much in the same way 55 
as a mouse, a keyboard, or other peripheral device 
would be used to control projection image 29 via direct 
input to display computer 21. This method of control is 



especially useful in presentations where presenter 37 
needs to access and navigate Internet web links while 
speaking and moving about. 

[0023] Alternatively, a "drawing mode" can be 
accessed when laser pointer 1 1 is pulsed to produce 
three consecutive mouse clicks. In the drawing mode, 
laser spot 16 can be used to draw lines or curves on 
presentation image 13. To exit from the drawing mode, 
laser pointer 1 1 is pulsed to produce four mouse clicks. 
By drawing curves, additional functions can be exe- 
cuted during the presentation. In a preferred embodi- 
ment, when presenter 37 traces out a horizontal line in 
the text or graphics portion of presentation image 13, for 
example, processing section 35 generates a subse- 
quent electronic image 24 by combining initial electronic 
image 22a with an overlay, where the overlay provides a 
highlighting or underlining corresponding to the horizon- 
tal line traced out by laser spot 16. 
[0024] Subsequent electronic image 24 is then 
transmitted to projector 23 for projection as presentation 
image 13 having the corresponding text portion or 
graphic portion underscored or highlighted. Additionally, 
when presenter 37 traces out a rectangular shape 
enclosing a portion of presentation image 13, the corre- 
sponding portion of initial slide 22 is enlarged and trans- 
mitted as subsequent electronic image 24, so as to 
result in a zoom-in operation. 

[0025] In an alternative embodiment, shown in Fig. 
8, image projector 23 is directly connected to display 
computer 21 . This configuration can be used when con- 
trol system 30 provides only mouse commands to dis- 
play computer 21. Operation is similar to the 
embodiment described above, with laser spot 1 6 pro- 
jected onto presentation image 13 to provide control. 
Digital camera 31 samples presentation image 13 and 

acquired images 63a, 63b 63n are analyzed by 

processing section 35 in control module 33. When a 
match is found between an identified gesture spatial 
pattern and a pre-established gesture spatial pattern 
from reference section 36, a corresponding mouse 
command is transmitted to display computer 21 via 
serial cable 39. As in the previous embodiment, 
processing section 35 instructions and reference sec- 
tion 36 data may be retrieved from storage medium 67. 
[0026] Prior to operation of display presentation 
system 10, control system 30 may be calibrated by 
using processing section 35 to correlate the image ele- 
ments and positional coordinates of presentation image 
1 3 to the corresponding elements and coordinates com- 
prising initial electronic image 22a resident in display 
computer 21 . This may be done, for example, by, i) gen- 
erating an embedded predetermined pattern (not 
shown) in projection image 29, ii) acquiring presentation 
image 13, including the embedded pattern, by means of 
electronic camera 31, iii) detecting the predetermined 
pattern and establishing relevant positional coordinates 
within the image acquired by electronic camera 31 , and 
iv) analyzing the pattern coordinates to mathematically 
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correlate the coordinates of presentation image 13 to 
the coordinates of initial electronic image 22a. Such a 
calibration process is described in commonly-assigned, 
co-pending patent application entitled, "Method and 
apparatus for calibrating a computer-generated pro- 5 
jected image," filed on March 31, 1999, and assigned 
Serial No. 09/283,093 and incorporated herein by refer- 
ence in its entirety. 

[0027] Processing section 35 may additionally func- 
tion to determine the ambient light level in the presenta- 10 
tion area, as sensed by electronic camera 31, so as to 
provide for an optimal setting of the brightness and con- 
trast of presentation image 13. The color balance of 
presentation image 13 is optimized with image projector 
23 projecting a standardized color calibration chart (not 15 
shown) onto projection screen 12, and comparing the 
values of the projected colors, as acquired by electronic 
camera 31 , with the known values for the chart colors. 
From the comparison results, processing section 35 
determines the color corrections to be made and 20 
adjusts presentation image 13 accordingly. 
[0028] While the invention has been described with 
reference to particular embodiments, it will be under- 2. 
stood that the present invention is by no means limited 
to the particular constructions and methods herein dis- 25 
closed and/or shown in the drawings, but also com- 
prises any modifications or equivalents within the scope 
of the claims. 



nates (X/.y,-) corresponding to sequential 
positions of the laser spot in the initial pres- 
entation image; 

means for analyzing said sequence of 
positional coordinates so as to capture a 
gesture spatial pattern formed by said 
sequence of positional coordinates; 
means for matching said captured gesture 
spatial pattern to one of a set of pre-estab- 
lished gesture spatial patterns; 
means for selecting a display command, 
said selected display command correlated 
to said matched pre-established gesture 
spatial pattern; and 

means for generating a subsequent elec- 
tronic image in response to said selected 
display command, said subsequent elec- 
tronic image transmitted to the image pro- 
jector for projection onto the projection 
screen as a subsequent presentation 
Image. 

The control system of claim 1 wherein said means 
for locating the laser spot comprises means for 
identifying a bright image element, said bright 
image element comprising an acquired image ele- 
ment having a brightness exceeding a predeter- 
mined threshold value. 



Claims 30 

1. A display presentation control system suitable for 
use in providing control to a projection display 
apparatus including a display computer for generat- 
ing initial and successive electronic images, a com- 35 
puter-controlled image projector, a projection 
screen, and a laser pointer operating in pulsing and 
continuous-radiation modes, the projector for 
receiving the initial electronic image for projection 
onto the projection screen as an initial presentation 40 
image, and the laser pointer for providing the con- 
trol when used by a presenter to emit a laser spot 
onto the projection screen and project a spatial pat- 
tern on the initial presentation image, said control 
system comprising: 45 

an electronic camera directed at the initial pres- 
entation image and producing a sequence of 
acquired images thereof, each said acquired 
image comprising image elements; and, so 
a control module responsive to said acquired 
images, said control module comprising: 

means for locating the laser spot in said 
acquired images; 55 
means for assigning positional coordinates 
to each said located laser spot so as to 
produce a sequence of positional coordi- 



3. The control system of claim 2 wherein said means 
for locating the laser spot further comprises means 
for identifying a cluster of said bright image ele- 
ments, said cluster comprising a contiguous image 
element aggregate having a linear dimension 
exceeding a predetermined value. 

4. The control system of claim 1 wherein said means 
for assigning positional coordinates comprises 
means for analyzing said acquired image in a 
decreased-resolution mode. 

5. The control system of claim 1 wherein said means 
for analyzing positional coordinates comprises 
means for deriving a sequence of displacement 
vectors 7>((x /+1 — X/),(y /+1 — y/)), each said dis- 
placement vector corresponding to the difference in 
successive said positional coordinates. 

6. The control system of claim 5 wherein said means 
for analyzing positional coordinates comprises 
means for describing said sequence of displace- 
ment vectors by a sequence of Freeman chain 
codes. 

7. The control system of claim 1 further comprising 
means for detecting a laser spot pulse, said laser 
spot pulse produced by operating the laser pointer 
in its pulsing mode for a pre-established time inter- 
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val. 

8. The control system of claim 7 wherein said pre- 
established time interval is approximately three 
seconds. 5 

9. The control system of claim 7 wherein said display 
command comprises a first mouse click when an 
essentially stationary laser spot is detected in a 
pre-defined region of the initial presentation image w 
by said means for analyzing positional coordinates, 
said first mouse click transmitted to the display 
computer. 

10. The control system of claim 9 wherein said pre- is 
defined region comprises an icon. 

11. The control system of claim 9 wherein said first 
mouse click provides a drop-down menu in said . 
subsequent presentation image. 20 

12. The control system of claim 9 wherein said display 
command further comprises a second mouse click 
when said laser spot pulse is detected, said second 
mouse click transmitted to the display computer. 25 

13. The control system of claim 12 wherein said second 
mouse click initiates a selection of said pre-defined 
region of the initial presentation image in said sub- 
sequent presentation image. 30 

14. The control system of claim 7 wherein said selected 
display command comprises an overlay command 
correlated to the receipt of three said laser spot 
pulses, said overlay command producing a subse- 35 
quent electronic image comprising an overlay 
image superimposed on the initial electronic image. 

15. The control system of claim 14 wherein said overlay 
image comprises one or more curves correspond- 40 
ing to translational movements of the laser spot 
across the initial presentation image. 

16. The control system of claim 14 wherein said overlay . 
image comprises a highlighting region, said high- 45 
lighting region corresponding to translational move- 
ments of the laser spot across the initial 
presentation image. 

17. The control system of claim 15 wherein said so 
selected display command comprises a zoom-in 
command when said one or more curves define an 
enclosed portion of the initial presentation image, 
said zoom-in command producing a subsequent 
electronic image comprising an enlarged portion of 55 
the initial electronic image, said enlarged portion 
corresponding to said enclosed portion of the initial 
presentation image. 



18. The control system of claim 1 wherein said means 
for generating a subsequent electronic image com- 
prises means for transmitting a mouse command to 
the display computer, said subsequent electronic 
image transmitted to the image projector by the dis- 
play computer. 

19. The control system of claim 1 8 wherein said mouse 
command comprises a command for advancing to 
the next successive electronic image when said 
matched pre-established gesture spatial pattern 
comprises a right-hand arrowhead. 

20. The control system of claim 1 further comprising 
memory means for storing said positional coordi- 
nates. 

21. The control system of claim 20 wherein said mem- 
ory means comprises a reference section for stor- 
ing said display commands and said pre- 
established images. 

22. A display presentation control system suitable for 
use in providing control to a projection display 
apparatus including a display computer for generat- 
ing initial and successive electronic images, a com- 
puter-controlled image projector, a projection 
screen, and a laser pointer operating in pulsing and 
continuous-radiation modes, the projector for 
receiving the initial electronic image for projection 
onto the projection screen as an initial presentation 
image, and the laser pointer for providing the con- 
trol when used by a presenter to emit a laser spot 
onto the projection screen and project a spatial pat- 
tern on the initial presentation image, said control 
system comprising: 

an electronic camera directed at the initial pres- 
entation image and producing a sequence of 
acquired images thereof, each said acquired 
image comprising image elements; and, 
a control module responsive to said acquired 
images, said control module comprising: 

a memory section comprising a set of pre- 
established gesture spatial patterns and a 
set of display commands, each said dis- 
play command corresponding to one of 
said pre-established gesture spatial pat- 
terns; 

locating circuitry for locating the laser spot 
in said acquired images; 
image processing circuitry responsive to 
the locating of the laser spot in said 
acquired images, said image processing 
circuitry for assigning positional coordi- 
nates to each said located laser spot, for 
producing a sequence of positional coordi- 
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nates (x h y s ) corresponding to sequential 
positions of the laser spot in the initial pres- 
entation image, and for analyzing said 
sequence of positional coordinates so as 
to capture a gesture spatial pattern formed 
by said sequence of positional coordi- 
nates; and 

command circuitry responsive to said cap- 
tured gesture spatial pattern for matching 
said captured gesture spatial pattern to 
one of said pre-established gesture spatial 
patterns, for selecting one of said display 
commands corresponding to said matched 
gesture spatial pattern; and for generating 
a mouse command in response to said 
selected display command; 
said mouse command transmitted to the 
display computer such that a subsequent 
presentation image is projected onto the 
projection screen. 

23. The control system of claim 22 wherein said locat- 
ing circuitry comprises brightness detection cir- 
cuitry for identifying a bright image element, said 
bright image element comprising an acquired 
image element having a brightness exceeding a 
predetermined threshold value. 

24. The control system of claim 23 wherein said locat- 
ing circuitry further comprises cluster detection cir- 
cuitry for identifying a cluster of said bright image 
elements, said cluster comprising a contiguous 
image element aggregate having a linear dimen- 
sion exceeding a predetermined value. 

25. The control system of claim 23 wherein said image 
processing circuitry comprises computational cir- 
cuitry for deriving a sequence of displacement vec- 
tors 7v((x /+1 — x,),(y,- +1 — //)), each said 
displacement vector corresponding to the differ- 
ence in successive said positional coordinates. 

26. The control system of claim 25 wherein said com- 
putational circuitry further comprises conversion 
circuitry for converting said sequence of displace- 
ment vectors into a sequence of Freeman chain 
codes. 

27. A computer-readable storage medium containing 
instructions to direct a computer to function as a 
control system for: 

receiving a continuous sampling of images, 
each said image comprising a plurality of 
image elements; 

detecting a contiguous aggregate of bright 
image elements within each of a series of said 
images; 



assigning successive positional coordinates 
(X/.y,) to successive said detected bright image 
elements; 

analyzing said series of positional coordinates 
5 so as to identify a gesture spatial pattern; and 

generating a presentation command in accord- 
ance with said identification of said gesture 
spatial pattern. 

w 28. A storage medium as defined in claim 27 wherein 
said operation of analyzing said series of positional 
coordinates includes an operation of deriving a 
sequence of displacement vectors 7>((x, +1 — 
x / ),(y /+1 — y,)), each said displacement vector cor- 

15 responding to the difference in successive said 
positional coordinates. 

29. A storage medium as defined in claim 28 wherein 
said operation of deriving a sequence of displace- 

20 ment vectors included an operation of describing 
said sequence of displacement vectors by a 
sequence of Freeman chain codes. 

30. A storage medium as defined in claim 27 wherein 
25 said presentation command comprises a mouse 

command. 

31- A method for controlling a display presentation 
apparatus comprising a computer-controlled image 

30 projector projecting a sequence of presentation 
images onto a projection screen, control effected by 
means of a presenter using a laser pointer to 
project a laser spot onto the projection screen, the 
laser spot moved across the presentation image in 

35 a pre-established gesture spatial pattern, said 
method comprising the steps of: 

acquiring a series of images corresponding to 
the projected presentation image and laser 

40 spot, each said acquired image comprising a 

plurality of image elements; 
assigning a series of positional coordinates to 
the location of the laser spot within each 
acquired image; 

45 analyzing said, series of positional coordinates 

so as to identify the gesture spatial pattern pro- 
duced by the laser spot; and, 
generating a presentation command in accord- 
ance with said identification of the gesture spa- 

50 tiai pattern. 

32. The method of claim 31 further comprising the step 
of matching said identified gesture spatial pattern to 
the pre-established gesture spatial pattern. 

55 

33. The method of claim 31 wherein said step of ana- 
lyzing said positional coordinates comprises the 
step of detecting bright acquired image elements, 
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each said bright acquired image element having a 
brightness exceeding a predetermined threshold 
value. 

34. The method of claim 33 further comprising the step 5 
of identifying a cluster of bright acquired image ele- 
ments as the laser spot, said cluster comprising a 
contiguous acquired image element aggregate hav- 
ing a linear dimension exceeding a predetermined 
value. 10 

35. The method of claim 33 further comprising the step 
of detecting an essentially stationary laser spot. 

36. The method of claim 33 further comprising the step 75 
of selecting a portion of said initial slide in response 

to said detection of an essentially stationary laser 
spot. 

37. The method of claim. 35 further comprising the step 20 
of detecting a pulsing laser spot. 

38. The method of claim 37 further comprising the step 
of providing a drawn curve in said subsequent pres- 
entation image in response to the detection of said 25 
pulsing laser spot, said drawn curve corresponding 

to the movement of said laser spot. 

39. The method of claim 38 further comprising the step 

of highlighting a portion of said subsequent presen- 30 
tation image, said highlighted portion correspond- 
ing -to said drawn curve. 

40. The method of claim 31 wherein said step of ana- 
lyzing comprises the step of describing said identi- 35 
fied gesture spatial pattern by means of a Freeman 
chain code. 

41. The method of claim 40 wherein said step of gener- 
ating comprises the step of producing a sequential 40 
presentation image when said identified gesture 
spatial pattern comprises an arrowhead shape. 
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(54) Interactive display presentation system 

(57) An interactive presentation control system, 
used with a display computer, a computer-controlled im- 
age projector, a laser pointer, and a projection screen, 
comprises a digital camera and a control module. The 
display computer generates electronic images which 
are projected onto the projection screen as presentation 
images. During operation, a presenter uses the laser 
pointer to trace out a pre-established gesture spatial 
pattern onto the presentation image. The digital camera 
acquires these presentation images from which images 



a processing section in the control module analyzes and 
identifies the gesture spatial pattern. The identified ges- 
ture spatial pattern is compared to a set of pre-estab- 
lished patterns to find a match and to subsequently se- 
lect a correlated display command. The display com- 
mand, which can be executed within the control module 
or transmitted to the display computer, changes the 
presentation image by an action such as: advancing to 
the next image, highlighting a text segment, or zooming 
in on the image. 
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